Text Processing
Back to Home
01. Text Processing
02. Coding Exercises
03. Capturing Text Data
04. Quiz: Read Text Files
05. Cleaning
06. Normalization
07. Tokenization
08. Quiz: Split Sentences
09. Stop Word Removal
10. Part-of-Speech Tagging
11. Named Entity Recognition
12. Stemming and Lemmatization
13. Summary
Back to Home
07. Tokenization
Tokenization
INSTRUCTOR NOTE:
Reference:
nltk.tokenize
package:
http://www.nltk.org/api/nltk.tokenize.html
Next Concept